Skip to content

Conversation

@petedv
Copy link

@petedv petedv commented Sep 25, 2014

If done directly in python it is not OS dependent

@kmatt
Copy link

kmatt commented Sep 29, 2014

For near zero startup time, I replaced the line count with the size of the file in bytes as

num_bytes = os.path.getsize(input_filename)

then keep track the total of the line lengths as

bytes += len(line)

and calculate progress as

percentage_done = bytes / num_bytes
...
logging.write("\rLine %i (%.2f%%) [%s tables] [%s inserts] [ETA: %i min %i sec]"

I let my fork get out of sync with the master through multiple commits, otherwise I would put in a PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants